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The two long-baseline experiments ICARUS and OPERA have recently provided bounds on light 
eV) sterile neutrinos exploiting the results of the Ufj, appearance searches. Both collabora¬ 
tions have performed the data analysis using an effective 2-flavor description. We show that such a 
simplihed treatment neglects sizable genuine 4-flavor effects, which are induced by the interference 
of the new large squared-mass splitting Ami4 with the atmospheric one. The inclusion in the data 
analysis of such effects weakens the upper bounds on the effective appearance amplitude sin^ 
approximately by a factor of two. In addition, we point out that, in a 4-flavor scheme, the flavor 
oscillations involve also the component of the CNGS beam and can suppress the theoretical 
expectation of the background in a substantial way. The inclusion in the data analysis of the 
disappearance effects leads to a further weakening of the upper bounds on sin^ 29 which overall 
are relaxed by a factor of three with respect to those obtained in the effective 2-flavor description. 

PACS numbers: 14.60.Pq, 14.60.St 


I. INTRODUCTION 


One of the most interesting issues in present-day neu¬ 
trino physics is provided by the hints of light (~ eV) ster¬ 
ile species si^gested by the short-baseline (SBL) anoma¬ 
lies (see [iHS]). In the upcoming years new experiments 
will check if the anomalies are artifacts or real effects. In 
the mean time, sterile neutrinos can be actively investi¬ 
gated in other contexts. A particularly important exam¬ 
ple is that of the long-baseline (LBL) experiments. In 
these setups the distance-over-energy ratio L/E is much 
bigger than that probed in the SBL ones and no infor¬ 
mation on the new large squared-mass splitting can be 
recovered since the new high-frequency oscillations are 
completely averaged out. On the other hand, distinctive 
4-flavor effects can emerge exclusively at long distances, 
inducing modifications of the expected rate and of its 
energy spectrum. Such effects depend on the other oscil¬ 
lation parameters involved in the frameworks with extra 
sterile species, i.e. the new mixing angles and the new 
CP-violating phases. Notably, as first pointed out in Q, 
the LBL experiments are the sole setups where the new 
sterile-induced CP-phases can be measured. Indeed, the 
running experiment T2K is already providing precious 
hints on one of them Q. 

At the short baselines, LSND @ and MiniBooNE @ 
have observed an anomalous —>■ Vg appearance sig¬ 

nal and its (dis-)confirmation is one of the main targets 
of the sterile neutrino searches. Notal^, the two ex¬ 
periments ICARUS 0, II] and OPERA Q have recently 
provided the first bounds on the conversion us¬ 

ing LBL data. Both experiments have analyzed their re¬ 
sults using an effective 2-flavor framework. Here we show 
that such a treatment neglects sizable genuine 4-flavor ef¬ 
fects induced by the interference between the new large 
squared-mass splitting and the atmospheric one. Their 
inclusion in the data analysis provides upper bounds on 
the effective appearance mixing angle 0^,6 that are weaker 
approximately by a factor of two with respect to those 
obtained in the 2-flavor approach. In addition, we point 


out that, in a 4-flavor scheme, the flavor oscillations in¬ 
volve also the z/g component of the CNGS beam and can 
suppress the theoretical expectation of the background in 
a substantial way. The inclusion in the data analysis of 
the zze disappearance effects leads to a further weakening 
of the upper bounds on which overall are relaxed by 
a factor of three with respect to those obtained in the 
effective 2-flavor description. 


II. THEORETICAL FRAMEWORK 


In the presence of a fourth sterile neutrino zz^, the fla¬ 
vor and the mass eigenstates are connected through a 
4x4 mixing matrix. For LBL transitions, a convenient 
parameterization of the mixing matrix is 

U = R34R24R14R23R13R12 , (1) 


where Rij {Rij) represents a real (complex) 4x4 rotation 
in the (*, j) plane containing the 2x2 submatrix 


\-Si3 



R: 


2x2 




( 2 ) 


in the (*, j) sub-block, with 
Cij = cos 9 ij Sij = sin 0^ 


Sij = Sije (3) 


The parameterization in Eq. o enjoys the following 
properties: I) For vanishing mixing with the fourth state 
(044 = 024 = 034 = 0) it reduces to the 3-flavor matrix in 
its usual parameterization. II) The leftmost positioning 
of the matrix R34 makes the zz^^ —> zzg conversion proba¬ 
bility independent of 034 (and the related CP-phase ^34). 
Ill) For small values of 0i3 and of the mixing angles in¬ 
volving the fourth mass eigenstate, one has \Ue3\^ — S13, 
|Ue4p = sf4 (exact), 11/4^4P and \Ur4\^ with 

a clear physical interpretation of the new mixing angles. 

Let us now come to the flavor conversions relevant for 
ICARUS and OPERA. In the 3-flavor limit, the zz^j —>■ zzg 
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transition probability can be written as the sum of three 
distinct terms. The first one is driven by the atmospheric 
splitting, the second one by the solar splitting, and the 
third one by their interference. For the baseline of L = 
732 km and the (average) energy E = 17 GeV probed 
with the CNGS beam, we have A = /4,E ^ 0.13 

for the atmospheric oscillating phase, while the solar one 
is thirty times smaller. Therefore, only the atmospheric 
term is relevant and we have 

Pie - 4si3Si3 sin^ A , (4) 

which is O(e^) in the small parameters S 13 ~ 0.15 and 
A ~ 0.13, which can be both assumed of order e. 

In the 4-flavor case, neglecting the solar squared-mass 
splitting, the transition probability can be expressed as 
the sum of three terms , 

pAu ^ pATM ^ pINT ^ pSTR ^ ( 5 ) 

driven respectively by the atmospheric splitting, the ster¬ 
ile one and by their interference. After averaging over the 
fast oscillations induced by the large frequency Ato^ 4 , we 
find in vacuum 

pZ = cIAaPI: ( 6 ) 

-I- 4 C 44 C 24 S 14 S 24 S 13 S 23 sin A sin( A -|- 5') 

+ 2 C 44 S 44 S 24 , 

where 5' = ( 5 i 3 — ( 5 i 4 . The first term in Eq. (O coincides 
with the 3-flavor probability apart from the multiplying 
factor 0 ^ 4024 . The second term encodes the interference 
effects and can assume both positive and negative val¬ 
ues. The third term can be interpreted as the averaged 
transition probability in an effective 2 -flavor description. 

The interference term depends on the neutrino mass 
hierarchy (NMH), i.e. from the sign of A, which is posi¬ 
tive for normal hierarchy (NH) and negative for inverted 
hierarchy (IH). While for a fixed value of the GP-phase 
5' ^ (0, tt) the interference term depends on the NMH, it 
is invariant under the simultaneous transformations 

A ^ -A, 8 ' ^ - 8 '. (7) 

This implies that there is a complete degeneracy among 
the NMH and the sign of the GP-phase 8 '. For small 
values of A, like those involved in the CNGS beam, the 
following approximate proportionality relation holds 

piNT ^ 2/y gin ^ (g) 

which implies that the amplitude of the interference term 
is maximal for 8 ' ~ ±7r/2. 

Inspection of Eq. m shows that the interference and 
the sterile terms are proportional, respectively, to the 
first and the second power of the quantity 

sin2d^e = 2 |Ge 4 ||I 7 ^ 4 | — 2 C 14 S 14 S 24 ; (9) 

which defines the effective appearance mixing angle 
probed in the SHE —>■ Vg experiments. Furthermore, 


Contributions to the transition probability 



FIG. 1: Behavior of the three terms of the —>■ Vs transition 
probability for the CNGS parameters (L = 732 km, E = 
17 GeV) as a function of sin^ 20^6 in the case \Uei\ = |G^ 4 |. 

the atmospheric and interference terms are respectively 
proportional to the factor T = cf 4 c |4 and to its squared 
root. Therefore, Eq. (|6]) can be recast in the form 

PZ = ^pZ ( 10 ) 

-I- 2-\/)Fsin20^eSi3S23 sin Asin(A-I-(S') 

1 . 9 

+ — sin 20^6 ■ 

In the particular case |17e4| = the suppression fac¬ 

tor is a function of the sole effective appearance angle^ 

p = c?4cL = 1 - |C^e4p - |G^4p = 1 - sin20^e , (H) 

and the transition probability is sensitive to the 4-flavor 
effects only through such an effective mixing angle. 

It is now crucial to observe that the official analyses 
performed by IGARUS and OPERA make use of an ef¬ 
fective 2-flavor description, which by definition neglects 
the interference term in the transition probability. In or¬ 
der to determine the level of (in-)accuracy of the 2-flavor 
approximation, we must evaluate the relative size of the 
three terms in the conversion probability. 

Figure 1 displays their behavior as a function of 
sin^ 2dfj_e. For the interference term, which can have both 
positive and negative sign, we have plotted its maximal 
absolute value. In Fig. 1 we have assumed \Ue 4 \ = |C7^4|, 
in which case 9fj,e is the sole (4-flavor) mixing angle 
entering the transition probability, as explained above. 


^ It can be observed that, for a fixed value of the factor E 
is always smaller than that obtained in the case \Ue 4 \ = |F/i 4 |. 
In fact, the inequality (|I/e 4 | — |F(i 4 |)^ > 0 implies that E = 
1 - (|Fe4|2 + |C/^4|2) < 1 - 2|I/e4||f/Ml = 1 " sin20^e. 
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For relatively small values of the two new mixing an¬ 
gles (|t/e 4 p, < 0 . 2 ), this assumption is almost ir¬ 

relevant and for whatever choice of |C/e 4 p ^ 
plot would be almost identical. For very large values of 
|C/e 4 p (or |t/^ 4 p) sizable deviations would appear in the 
atmospheric and interference terms if \Uei\ ^ (or 

\UeA\ \U^ 4 \)- It is important to stress that, in any case, 
their amplitude would be always smaller than that ob¬ 
tained for \Ue 4 \ = \Ufj,A\ displayed in Fig. 1 (see footnote 
1 and discussion of Fig. 5). 

As expected from Eq. OT, for small values of the 
sterile term (solid line) and the interference one (dashed 
line) display a power-law behavior. For very large values 
of O^e, the interference term deviates from the power-law 
behavior because of the effect of the suppressing factor 
•\/(F, which becomes appreciably smaller than one. In the 
atmospheric term (dotted line), T is the sole source of the 
dependence on O^f.. This terms assumes the maximum 
value in the 3-flavor limit (d^e = 0) and decreases with 
increasing 9^^- In the region sin^ 20 ^e ^ 0 . 1 , the factor 
F becomes very small and drastically suppresses both 
the atmospheric and the interference terms. 

For values of S 14 and S 24 similar to that of sis (~ 0.15), 
which are favored by the SBL global fits [2i 0| , we can 
assume that the three mixing angles and the atmospheric 
oscillating phase A ~ 0.13 have all the same order of 
magnitude e. In this regime, corresponding roughly to 
sin^ 20^6 — few x 10 “^, all the three terms have the 
same order e^, and the transition probability is below 
the current sensitivity of the two experiments. 

As can be deduced from Fig. 1, for the values of the 
transition probability currently probed by ICARUS and 
OPERA (P^e few X 10“^), roughly corresponding to 
sin^ 26fj_e ^ 10 “^, the absolute size of the interference 
term is comparable to (approximately one half of) the 
sterile term. This means that, for those values of the 
CP-phase 6 ' that render the interference term maximal 
and negative, the overall signal decreases by a factor of 
two with respect to the effective 2 -flavor description. 

Eigure 2 further illustrates the role of the 4-flavor ef¬ 
fects, representing P^e as a function of the neutrino en¬ 
ergy. The (common) value chosen for the two mixing 
angles ( 3^4 = S 24 = 0.05) corresponds to an effective 
appearance mixing angle sin^ 2 d^e ~ 10 “^, close to the 
sensitivity of the two experiments. The thin dotted curve 
represents the atmospheric contribution, while the thin 
dotted-dashed (horizontal) line is the (energy indepen¬ 
dent) effective 2-flavor probability. The sum of these two 
terms, represented by the thick dashed curve, is the prob¬ 
ability implemented in the official analyses. The two solid 
curves correspond to the 4-flavor transition probability 
calculated for the two values of the CP-phase S' = -^-k j2 
in the case of normal hierarchy. We see again that, in the 
energy region of interest, located around [10 — 30] GeV, 
the transition probability is quite different from the one 
used by the two collaborations. In addition, we can ob¬ 
serve that the interference term appreciably modihes the 
energy dependence of the probability. 



FIG. 2: Transition probability as a function of the neutrino 
energy. The dotted curve represents the atmospheric term, 
while the dotted-dashed (horizontal) line is the sterile one. 
The sum of these two contributions, represented by the dashed 
curve, is the probability implemented in the official analyses. 
The two solid lines correspond to the (averaged) 4 : 1 / probabil¬ 
ity in the NH case for the two values S' = ±7r/2. 


The discussion made above makes it clear that the 
inclusion of the interference effects in the analysis is 
expected to introduce substantial modifications of the 
bounds obtained in their absence. In particular, the up¬ 
per limits on 9^e should become weaker since the interfer¬ 
ence term, when negative, decreases the predicted signal. 
This qualitative expectation will be quantified by the nu¬ 
merical analysis presented in the next section. 

An important remark is in order before presenting the 
results of the analysis. Both ICARUS and OPERA op¬ 
erate in a background-dominated regime and the i/g con¬ 
tamination of the CNGS beam is the main (almost the 
sole) source of background to the —>■ Ue signal. In 

the 3-flavor limit the Vg —>■ Vg survival probability Pgg 
is equal to one apart from negligible O(e^) corrections. 
In this case, the Vg beam component is unaffected by the 
oscillations and the background can be considered a fixed 
quantity. Differently, in a 4-flavor scheme, the survival 
probability Pgg can be appreciably different from unity 
and one cannot assume that the i/g background is a fixed 
quantity as done in the official analyses of the two col¬ 
laborations. In the region of high values of where 

the oscillations are averaged, we have 

Pee-l-2|C/e4p(l-|C/e4n. (12) 

It is evident that large values of |? 7 e 4 | are expected to 
substantially suppress the background and thus decrease 
the sensitivity to a potential signal coming from the —>■ 
i/g transitions. The analysis presented in the next section 
will take this aspect into proper account. 
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OPERA constraints (|Ue4l = |U^|) 
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FIG. 3: Upper bounds (90% C.L.) obtained for a fixed (large) 
value of Ami 4 in the two cases of NH and IH. The effect of the 
oscillations on the Us component is neglected setting Pee = 1- 


FIG. 4: Upper bounds (90% G.L.) obtained in the case of 
NH. The CP-phase S' is marginalized away. The effect of the 
oscillations on the zze component is neglected setting Pee = 1. 


III. NUMERICAL ANALYSIS 

In our analysis we use the results of the ^ ap¬ 
pearance searches provided in 0, Q for ICARUS and 
in 0 for OPERA. In order to calculate the theoretical ex¬ 
pectation for the total number of events, we convolve the 
product of the flux, the cross-section, and the —>■ 

transition probability^ with the energy resolution func¬ 
tion and the detection efficiency. A similar computation 
is performed for the Vg beam component, incorporating 
the Ve —t r'e survival probability. We have checked that 
our predictions for the expected Ve rate are in good agree¬ 
ment with those published. For definiteness, we show the 
results obtained for the OPERA experiment, the case of 
ICARUS being completely analogous. To make the dis¬ 
cussion more clear, in our analysis, we first consider the 
particular case Pee = 1 , i-e. we neglect the oscillations 
of the Ve beam component (Figs. 3 and 4). Then, we 
extend our analysis to the general case Pee < 1 (Fig. 5). 
This way of presenting the results will allow us to sepa¬ 
rate the effects on the appearance from those, 

conceptually different, related to the disappearance. 

Figure [3] shows the 90% C.L. upper bounds that we 
obtain on the appearance mixing angle as a function 
of the CP-phase 5' for the OPERA experiment in the 
two cases of NH (upper panel) and IH (lower panel) 
for Am ^4 = leV^. In both panels, the dashed vertical 
line represents the upper bound that we obtain in the 2 - 
flavor approximation (sin^ 20^e % 5.2 x 10“^), which is in 
good agreement with the limit quoted by OPERA. The 


^ We have calculated the transition probability numerically includ¬ 
ing the matter effects, albeit these have a negligible role. 


solid contour represents the upper bounds obtained in 
the 4-flavor scheme, assuming |17e4| = \U^i\ and Pee = 1- 
As expected, a dependence on the CP-phase 5' appears 
that is different in the two cases of NH and IH. The 
4-flavor upper limits are substantially stronger (weaker) 
than those obtained in the 2 -flavor case when the interfer¬ 
ence term assumes positive (negative) values. The maxi¬ 
mal excursion from the 2 -flavor result, basically identical 
for NH and IH, is obtained for 5' ~ ± 7 r/ 2 , as expected 
from the discussion made in Sec. H. 

Figure 0] shows the upper bounds in the usual plane 
[sin^ 20^6, ATO 44 ]. The constraints displayed for the 4- 
flavor case, valid for \UeA\ = \U^i\ and Pee = I, corre¬ 
spond to the case of NH and are obtained by marginal¬ 
izing away the CP-phase 5'. For IH the results (not 
shown) are basically identical. It is evident that, inde¬ 
pendently of the value of the upper limits ob¬ 

tained by the full 4-flavor analysis are approximately a 
factor of two weaker than those obtained in the 2 -flavor 
case. More precisely, in the high-Am 44 region, we obtain 
sin 2 26»^e < 1.2 x IQ-^. 

The upper bounds presented in Figs. 3 and 4 have been 
obtained for the particular choice |Ue 4 | = \Ufi 4 \. Hence, 
the question arises on which kind of deviations emerges 
when this condition is relaxed. It can be easily seen that 
for any choice of \Ue 4 \ ^ |bt^ 4 | the bounds are stronger 
than those derived in the particular case \Ue 4 \ = |C^ 4 |- In 
fact, in this last case, the amplitude of the interference 
term is maximized (see footnote I) and the deviations 
from the 2-flavor description are maximal. Hence, the 
case presented provides the weakest bounds on Fig¬ 
ure 5 visualizes this behavior, showing the constraints ob¬ 
tained in the general case, i.e. when the two amplitudes 
|C/e 4 p and |U^ 4 p are both allowed to vary (respecting the 
unitarity constraint |C/e 4 p -|- |C/p 4 p A !)■ The new split- 
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FIG. 5: Upper bounds (90% C.L.) obtained from the OPERA 
experiment for the case of normal hierarchy. The CP-violating 
phase S' is marginalized away. See the text for details. 

ting is fixed at Arrii^ = 1 eV^, while the CP-phase S' is 
marginalized away. In the 2-flavor approximation (dot¬ 
ted line) we re-obtain the bound sin^ < 5.2 x 10“^, 
which in the log-log plot of Fig. 5 is represented by a 
diagonal line with a negative slope of 45° (we recall 
that sin^ 20^e = 4|[/e4p|[/^4p). The solid curve repre¬ 
sents the bounds obtained when the interference term 
is “switched on” in the conversion probability. It can 
be clearly seen that the weakest bound is obtained for 
|C/e 4 | = \Ufi 4 \ as anticipated, in which case we re-obtain 
sin^ 20^6 ^ 1-2 X 10“^. For different choices of the mixing 
amplitudes the upper bounds exhibit deviations that are 
generally small, becoming appreciable only if one of the 
two amplitudes is very large. 

Let us now come to the impact of the oscillations on 
the Ve beam component. In the results shown in Figs. 3 
and 4 we have imposed Pee = 1, i.e. we have fixed the 
Ve flux at its non-oscillated value. Now we relax such 
a condition allowing for values of Pee <1. In Fig. 5, 
the (red) dashed curve represents the upper bounds ob¬ 
tained in such more general situation. We see that, for 
large values of |17e4p, there are appreciable deviations 
from the particular case Pee = 1. Larger values of the 


appearance mixing angle 6 ^e are now allowed by the fit. 
More precisely, from Fig. 5 we derive the upper bound 
sin^ 20^6 ^ l-7x 10“^, which is a factor ~ 3/2 bigger than 
that found in the case Pee = I (sin^ 20^e ^ 1-2 x 10“^) 
and an overall factor ~ 3 weaker than that derived using 
the 2-flavor approximation (sin^ 20^e < 5.2 x 10“^). The 
reasons of this behavior can be traced to the fact that the 
fit has now more flexibility and to the circumstance that 
the number of Ve events measured by OPERA (and also 
by ICARUS) is appreciably lower than the theoretical 
(non-oscillated) background prediction. When including 
in the fit the possibility of having Pee < 1, a large non¬ 
zero value of |?7e4p is preferred, since this suppresses the 
background prediction and provides a better agreement 
with the observations. In this case, larger values of the 
Vfi —> Ve signal are naturally permitted by the fit and, as 
a consequence, bigger values of 6 ^e are allowed. 

IV. CONCLUSION 

The two long-baseline experiments ICARUS and 
OPERA have recently performed sterile neutrino 
searches using the v^ —>■ Ve measurements. Both collabo¬ 
rations have presented upper bounds on the effective ap¬ 
pearance mixing angle O^e obtained with analyses which 
make use of an effective 2-flavor description. We have 
shown that a consistent treatment of the results must in¬ 
clude genuine 4-flavor interference effects, which develop 
on the long distances involved in the CNGS setup. Our 
quantitative study shows that their inclusion weakens the 
upper bounds on 9^e approximately by a factor of two. 
We have also pointed out that, in a 4-flavor scheme, the 
sterile-induced Ve disappearance is of high relevance. Its 
inclusion in the data analysis leads to a further weaken¬ 
ing of the upper bounds on O^e , which overall are relaxed 
by a factor of three with respect to those obtained in the 
effective 2-flavor description. In conclusion, the 4-flavor 
effects that we have investigated have a substantial im¬ 
pact on the data interpretation. Therefore, they should 
be included in any accurate analysis. 
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